Application Number 10/650,121 

Amendment in Response to Office Action mailed November 1, 2005 

AMENDMENTS TO THE CLAIMS 

This listing of claims will replace all prior versions and listings of claims in the application. 

Listing of Claims: 

1 . (Original) A method comprising: 

defining a linear programming formulation of a support vector machine classifier; 
solving an exterior penalty function of a dual of the linear programming formulation to 
produce a solution to the support vector machine classifier; and 

selecting an input set for the support vector machine classifier based on the solution. 

2. (Original) The method of claim 1 , further comprising minimizing the exterior penalty 
function for a finite value of a penalty parameter. 

3. (Original) The method of claim 1, wherein the linear programming formulation is a 1-norm 
linear programming formulation. 

4. (Original) The method of claim 1 5 wherein the solution is a least 2-norm solution. 

5. (Original) The method of claim 1 , wherein the support vector machine classifier is a linear 
support vector machine classifier, and selecting an input set includes selecting a set of input 
features of the linear support vector machine classifier. 

6. (Original) The method of claim 1 , wherein the support vector machine classifier is a 
nonlinear support vector machine classifier, and selecting an input set includes selecting a set of 
kernel functions for the nonlinear support vector machine classifier. 
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7. (Currently Amended) The method of claim 1, further comprising: 

calculating a separating surface based on the selected input set and the support vector 
machine classifier; and 

classifying data using the separating surface. 

8. (Original) The method of claim 7, further comprising classifying the data into two sets of 
data using the separating surface. 

9. (Original) The method of claim 7, wherein the separating surface is one of an n-dimensional 
hyperplane or a nonlinear surface. 

10. (Original) The method of claim 1 , further comprising applying a Newton-based algorithm to 
solve the exterior penalty function. 

1 1 . (Original) The method of claim 1 , further comprising applying one or more linear constraints 
to the solution of the exterior penalty function. 

12. (Original) The method of claim 1, wherein selecting an input set includes selecting a subset 
of input features from a larger set of input features that is substantially larger than the subset of 
input features. 

13. (Original) The method of claim 12, wherein the subset of input features includes less than 
approximately one percent of the larger set of input features. 

14. (Original) The method of claim 12, wherein the subset of input features includes less than 
approximately .1 percent of the larger set of input features. 

15. (Original) The method of claim 12, wherein the larger set of input features includes more 
than 20,000 input features, and the subset of input features includes less than ten input features. 
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16. (Original) A classification system comprising: 

a processor that applies a linear programming formulation of a support vector machine 
classifier to classify data based on an input set; and 

an input module that generates the input set based on a solution of an exterior penalty 
function of a dual of the linear programming formulation. 

17. (Original) The system of claim 16, wherein the input module generates the input set based 
on a minimization of the exterior penalty function for a finite value of a penalty parameter. 

18. (Original) The system of claim 16, wherein the linear programming formulation is a 1-norm 
linear programming formulation. 

19. (Original) The system of claim 16, wherein the solution is a least 2-norm solution. 

20. (Original) The system of claim 16, wherein the support vector machine classifier is a linear 
support vector machine classifier, and the input set includes a set of input features of the linear 
support vector machine classifier. 

21. (Original) The system of claim 16, wherein the support vector machine classifier is a 
nonlinear support vector machine classifier, and the input set includes a set of kernel functions 
for the nonlinear support vector machine classifier. 

22. (Currently Amended) The system of claim 16, wherein the processor calculates a 
separating surface based on the selected input set and the support vector machine classifier, and 
classifies data using the separating surface. 

23. (Original) The system of claim 22, wherein the processor classifies the data into two sets of 
data using the separating surface. 
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24. (Original) The system of claim 22, wherein the separating surface is one of an n-dimensional 
hyperplane or a nonlinear surface. 

25. (Original) The system of claim 16, wherein the input module applies a Newton-based 
algorithm to solve the exterior penalty function. 

26. (Original) The system of claim 16, wherein the solution to the exterior penalty function is 
subject to one or more linear constraints. 

27. (Original) The system of claim 16, wherein the input set is a subset of input features selected 
from a larger set of input features that is substantially larger than the subset of input features. 

28. (Original) The system of claim 27, wherein the subset of input features includes less than 
approximately one percent of the larger set of input features. 

29. (Original) The system of claim 27, wherein the subset of input features includes less than 
approximately .1 percent of the larger set of input features. 

30. (Original) The system of claim 27, wherein the larger set of input features includes more 
than 20,000 input features, and the subset of input features includes less than ten input features. 

3 1 . (Original) A computer-readable medium comprising instructions to cause a processor to: 

define a linear programming formulation of a support vector machine classifier; 
solve an exterior penalty function of a dual of the linear programming formulation to 
produce a solution to the support vector machine classifier; and 

select an input set for the support vector machine classifier based on the solution. 

32. (Original) The computer-readable medium of claim 3 1 , further comprising instructions to 
cause a processor to minimize the exterior penalty function for a finite value of a penalty 
parameter. 
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33. (Original) The computer-readable medium of claim 31, wherein the linear programming 
formulation is a 1-norm linear programming formulation. 

34. (Original) The computer-readable medium of claim 31, wherein the solution is a least 2- 
norm solution. 

35. (Original) The computer-readable medium of claim 31, wherein the support vector machine 
classifier is a nonlinear support vector machine classifier, and the input set includes a set of input 
features for the linear support vector machine classifier. 

36. (Original) The computer-readable medium of claim 31, wherein the support vector machine 
classifier is a nonlinear support vector machine classifier, and the input set includes a set of 
kernel functions for the nonlinear support vector machine classifier. 

37. (Currently Amended) The computer-readable medium of claim 31, further comprising 
instructions to cause a processor to: 

calculate a separating surface based on the selected input set and the support vector 
machine classifier; and 

classify data using the separating surface. 

38. (Original) The computer-readable medium of claim 37, further comprising instructions to 
cause a processor to classify the data into two sets of data using the separating surface. 

39. (Original) The computer-readable medium of claim 37, wherein the separating surface is one 
of an n-dimensional hyperplane and a nonlinear surface. 

40. (Original) The computer-readable medium of claim 31, further comprising instructions to 
cause a processor to apply a Newton-based algorithm to solve the exterior penalty function. 
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41 . (Original) The computer-readable medium of claim 3 1 , further comprising instructions to 
cause a processor to apply one or more linear constraints to the solution of the exterior penalty 
function. 

42. (Original) The computer-readable medium of claim 31, further comprising instructions to 
cause a processor to select a subset of input features from a larger set of input features that is 
substantially larger than the subset of input features. 

43. (Original) The computer-readable medium of claim 42, wherein the subset of input features 
includes less than approximately one percent of the larger set of input features. 

44. (Original) The computer-readable medium of claim 42, wherein the subset of input features 
includes less than approximately .1 percent of the larger set of input features. 

45. (Original) The computer-readable medium of claim 42, wherein the larger set of input 
features includes more than 20,000 input features, and the subset of input features includes less 
than ten input features. 

46. (New) The method of claim 1 , further comprising applying the support vector machine 
classifier to classify data relating to one of fraud detection, credit evaluation, gene expression, 
intrusion detection, medical diagnosis or medical prognosis. 

47. (New) The method of claim 1 , further comprising applying the support vector machine 
classifier to classify data relating to multiple myeloma. 

48. (New) The method of claim 1 , further comprising applying the support vector machine 
classifier to classify data relating to absolute call measurements for multiple myeloma. 

49. (New) The system of claim 16, wherein the processor applies the support vector machine 
classifier to classify data relating to one of fraud detection, credit evaluation, gene expression, 
intrusion detection, medical diagnosis or medical prognosis. 
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50. (New) The system of claim 16, wherein the processor applies the support vector machine 
classifier to classify data relating to multiple myeloma. 

5 1 . (New) The method of claim 1 6, wherein the processor applies the support vector 
machine classifier to classify data relating to absolute call measurements for multiple myeloma. 

52. (New) The computer-readable medium of claim 3 1 , wherein the instructions cause the 
processor to apply the support vector machine classifier to classify data relating to one of fraud 
detection, credit evaluation, gene expression, intrusion detection, medical diagnosis or medical 
prognosis. 

53. (New) The computer-readable medium of claim 3 1 , wherein the instructions cause the 
processor to apply the support vector machine classifier to classify data relating to multiple 
myeloma. 

54. (New) The computer-readable medium of claim 3 1 , wherein the instructions cause the 
processor to apply the support vector machine classifier to classify data relating to absolute call 
measurements for multiple myeloma. 

55. (New) A support vector machine classification system comprising: 

a data storage medium storing input data for classification; 

a support vector machine classifier that classifies the input data into a first set of data and 
a second set of data based on a set of input features; and 

a selection module that produces a reduced set of input features for the support vector 
machine classifier based on a minimization of an exterior penalty function of a dual of a linear 
programming formulation of the linear support vector machine classifier for a finite value of a 
penalty parameter. 
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56. (New) The system of claim 55, wherein the selection module includes: 

a dual generator that generates the dual of a linear programming formulation of the linear 
support vector machine classifier; and 

an exterior penalty function solver that minimizes the exterior penalty function of the 
dual; and 

a feature generator that generates the reduced set of input features for the support vector 
machine classifier. 

57. (New) The system of claim 55, wherein the support vector machine classifier classifies 
data relating to one of fraud detection, credit evaluation, gene expression, intrusion detection, 
medical diagnosis or medical prognosis. 



